Tootfinder

When to Retrieve: Teaching LLMs to Utilize Information Retrieval Effectively
Tiziano Labruna, Jon Ander Campos, Gorka Azkune
https://arxiv.org/abs/2404.19705 https://arxiv.org/pdf/2404.19705
arXiv:2404.19705v1 Announce Type: new
Abstract: In this paper, we demonstrate how Large Language Models (LLMs) can effectively learn to use an off-the-shelf information retrieval (IR) system specifically when additional context is required to answer a given question. Given the performance of IR systems, the optimal strategy for question answering does not always entail external information retrieval; rather, it often involves leveraging the parametric memory of the LLM itself. Prior research has identified this phenomenon in the PopQA dataset, wherein the most popular questions are effectively addressed using the LLM's parametric memory, while less popular ones require IR system usage. Following this, we propose a tailored training approach for LLMs, leveraging existing open-domain question answering datasets. Here, LLMs are trained to generate a special token, , when they do not know the answer to a question. Our evaluation of the Adaptive Retrieval LLM (Adapt-LLM) on the PopQA dataset showcases improvements over the same LLM under three configurations: (i) retrieving information for all the questions, (ii) using always the parametric memory of the LLM, and (iii) using a popularity threshold to decide when to use a retriever. Through our analysis, we demonstrate that Adapt-LLM is able to generate the token when it determines that it does not know how to answer a question, indicating the need for IR, while it achieves notably high accuracy levels when it chooses to rely only on its parametric memory.

Isochrone Fitting of Galactic Globular Clusters -- VI. High-latitude Clusters NGC5024 (M53), NGC5053, NGC5272 (M3), NGC5466, and NGC7099 (M30)
G. A. Gontcharov, S. S. Savchenko, A. A. Marchuk, C. J. Bonatto, O. S. Ryutina, M. Yu. Khovritchev, V. B. Il'in, A. V. Mosenkov, D. M. Poliakov, A. A. Smirnov
https://arxiv.org/abs/24…

Isochrone Fitting of Galactic Globular Clusters -- VI. High-latitude Clusters NGC5024 (M53), NGC5053, NGC5272 (M3), NGC5466, and NGC7099 (M30)
We fit various colour-magnitude diagrams (CMDs) of the high-latitude Galactic globular clusters NGC\,5024 (M53), NGC\,5053, NGC\,5272 (M3), NGC\,5466, and NGC\,7099 (M30) by isochrones from the Dartmouth Stellar Evolution Database and Bag of Stellar Tracks and Isochrones for $α$-enrichment [$α$/Fe]$=+0.4$. For the CMDs, we use data sets from {\it Hubble Space Telescope}, {\it Gaia}, and other sources utilizing, at least, 25 photometric filters for each cluster. We obtain the following charact…

Influence of mechanical compliance of the substrate on the morphology of nanoporous gold thin films
Sadi Shahriar, Kavya Somayajula, Conner Winkeljohn, Jeremy Mason, Erkin Seker
https://arxiv.org/abs/2402.11694

Influence of mechanical compliance of the substrate on the morphology of nanoporous gold thin films
Nanoporous gold (np-Au) has found use in applications ranging from catalysis to biosensing where pore morphology plays a critical role in performance. While morphology evolution of bulk np-Au has been widely studied, knowledge about its thin film form is limited. This work hypothesizes that mechanical compliance of the thin film substrate can play a critical role in the morphology evolution. Via experimental and finite-element-analysis approaches, we investigate the morphological variation in n…

A Comprehensive Review of Software and Hardware Energy Efficiency of Video Decoders
Matthias Kr\"anzler, Christian Herglotz, Andr\'e Kaup
https://arxiv.org/abs/2402.09001

A Comprehensive Review of Software and Hardware Energy Efficiency of Video Decoders
Energy and compression efficiency are two essential parts of modern video decoder implementations that have to be considered. This work comprehensively studies the following six video coding formats regarding compression and decoding energy efficiency: AVC, VP9, HEVC, AV1, VVC, and AVM. We first evaluate the energy demand of reference and optimized software decoder implementations. Furthermore, we consider the influence of the usage of SIMD instructions on those decoder implementations. We find…

This https://arxiv.org/abs/2312.10323 has been replaced.
link: https://scholar.google.com/scholar?q=a

Continuous Prompt Generation from Linear Combination of Discrete Prompt Embeddings
The wayward quality of continuous prompts stresses the importance of their interpretability as unexpected and unpredictable behaviors appear following training, especially in the context of large language models automating people-sensitive tasks such as resume screening. In this paper we present a novel method of constructing continuous prompts via discrete prompt embeddings and evaluate improvements to continuous prompt interpretability and inference accuracy. For a set of manually designed di…

This https://arxiv.org/abs/2309.12055 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_mat…

Genetic Composition of Supercritical Branching Populations under Power Law Mutation Rates
We aim at understanding the evolution of the genetic composition of cancer cell populations. To this aim, we consider a branching individual based model representing a cell population where cells divide, die and mutate along the edges of a finite directed graph $(V,E)$. The process starts with only one cell of trait $0$. Following typical parameter values in cancer cell populations we study the model under \textit{large population and power law mutation rates limit}, in the sense that the mutat…

Isochrone fitting of Galactic globular clusters -- V. NGC6397 and NGC6809 (M55)
George A. Gontcharov, Charles J. Bonatto, Olga S. Ryutina, Sergey S. Savchenko, Aleksandr V. Mosenkov, Vladimir B. Il'in, Maxim Yu. Khovritchev, Alexander A. Marchuk, Denis M. Poliakov, Anton A. Smirnov, Jonah Seguine
https://arxiv.org/abs/2402.0…

Isochrone fitting of Galactic globular clusters -- V. NGC6397 and NGC6809 (M55)
We fit various colour-magnitude diagrams (CMDs) of the Galactic globular clusters NGC\,6397 and NGC\,6809 (M55) by isochrones from the Dartmouth Stellar Evolution Database (DSED) and Bag of Stellar Tracks and Isochrones (BaSTI) for $α$-enhanced [$α$/Fe]$=+0.4$. For the CMDs, we use data sets from {\it HST}, {\it Gaia}, VISTA, and other sources utilizing 32 and 23 photometric filters for NGC\,6397 and NGC\,6809, respectively, from the ultraviolet to mid-infrared. We obtain the following charac…

AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
Qian Yang, Jin Xu, Wenrui Liu, Yunfei Chu, Ziyue Jiang, Xiaohuan Zhou, Yichong Leng, Yuanjun Lv, Zhou Zhao, Chang Zhou, Jingren Zhou
https://arxiv.org/abs/2402.07729

AIR-Bench: Benchmarking Large Audio-Language Models via Generative Comprehension
Recently, instruction-following audio-language models have received broad attention for human-audio interaction. However, the absence of benchmarks capable of evaluating audio-centric interaction capabilities has impeded advancements in this field. Previous models primarily focus on assessing different fundamental tasks, such as Automatic Speech Recognition (ASR), and lack an assessment of the open-ended generative capabilities centered around audio. Thus, it is challenging to track the progres…

This https://arxiv.org/abs/2309.12055 has been replaced.
initial toot: https://mastoxiv.page/@arXiv_mat…

Genetic Composition of Supercritical Branching Populations under Power Law Mutation Rates
We aim at understanding the evolution of the genetic composition of cancer cell populations. To this aim, we consider a branching individual based model representing a cell population where cells divide, die and mutate along the edges of a finite directed graph $(V,E)$. The process starts with only one cell of trait $0$. Following typical parameter values in cancer cell populations we study the model under \textit{large population and power law mutation rates limit}, in the sense that the mutat…

Velocity Dispersion of the open cluster NGC 2571 by Radial Velocities and Proper Motions
Maxim V. KuleshUral Fderal University, Aleksandra E. SamirkhanovaUral Federal University, Giovanni CarraroPadova University, Joao Sales SilvaObservatorio Nacional, Roberto Capuzzo DolcettaLa Sapienza University, Anton F. SeleznevUral Federal University
https://…

Velocity Dispersion of the open cluster NGC 2571 by Radial Velocities and Proper Motions
We use a Kernel Density Estimator method to evaluate the stellar velocity dispersion in the open cluster NGC 2571. We derive the 3-D velocity dispersion using both proper motions as extracted from Gaia DR3 and single epoch radial velocities as obtained with the instrument FLAMES at ESO VLT. The mean-square velocity along the line-of-sight is found to be larger than the one in the tangential direction by a factor in the interval [6,8]. We argue that the most likely explanation for such an occurr…